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Abstract 

Order statistics theory is applied in this paper to probabilistic robust control theory to com- 
pute the minimum sample size needed to come up with a reliable estimate of an uncertain quan- 
tity under continuity assumption of the related probability distribution. Also, the concept of 
distribution-free tolerance intervals is applied to estimate the range of an uncertain quantity and 
extract the information about its distribution. To overcome the limitations imposed by the conti- 
nuity assumption in the existing order statistics theory, wc have derived a cumulative distribution 
function of the order statistics without the continuity assumption and developed an inequality 
showing that this distribution has an upper bound which equals to the corresponding distribution 
when the continuity assumption is satisfied. By applying this inequality, we investigate the min- 
imum computational effort needed to come up with an reliable estimate for the upper bound (or 
lower bound) and the range of a quantity. We also give conditions, which are much weaker than 
the absolute continuity assumption, for the existence of such minimum sample size. Furthermore, 
the issue of making tradeoff between performance level and risk is addressed and a guideline for 
making this kind of tradeoff is established. This guideline can be applied in general without 
continuity assumption. 
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1 Introduction 



It is now well-known that many deterministic worst-case robust analysis and synthesis problems are 
NP hard, which means that the exact analysis and synthesis of the corresponding robust control 
problems may be computational demanding [6j [T3l 115] . Moreover, the deterministic worst-case 
robustness measures may be quite conservative due to overbounding of the system uncertainties. As 
pointed out by Khargonekar and Tikku in the difficulties of deterministic worst-case robust control 
problems are inherent to the problem formulations and a major change of the paradigm is necessary. 
An alternative to the deterministic approach is the probabilistic approach which has been studied 
extensively by Stengel and co-workers, see for example, [TO], [11], and references therein. Aimed 
at breaking through the NP-hardness barrier and reducing the conservativeness of the deterministic 
robustness measures, the probabilistic approach has recently received a renewed attention in the work 
by Barmish and Lagoa [3], Barmish, Lagoa, and Tempo [5], Barmish and Polyak [3], Khargonekar 
and Tikku [9], Bai, Tempo, and Fu [JJ, Tempo, Bai, and Dabbene [12] , Yoon and Khargonekar |14j . 
and references therein. 

In particular, Tempo, Bai and Dabbene in [12] and Khargonekar and Tikku in [9] have derived 
bounds for the number of samples required to estimate the upper bound of a quantity with a certain 
a priori specified accuracy and confidence. It is further shown that this probabilistic approach for 
robust control analysis and synthesis has low complexity [9j[12]. It should also be pointed out that 
the uncertain parameters do not necessarily have to be random, they can be regarded as randomized 
variables as pointed out in [9]. 

One important open question in this area is the minimum computational effort (i.e., the minimum 
sample size) needed to obtain a reliable estimate for the upper bound (or lower bound, or the range) 
of an uncertain quantity. We shall answer this question in this paper. This paper is organized as 
follows. Section 2 presents the problem formulation and motivations. In Section 3, we derive a 
distribution inequality without the continuity assumption. Design tradeoff is discussed in Section 4 
using the distribution derived in Section 3. Section 5 gives the minimum sample size under various 
assumptions and Section 6 considers the tolerance intervals. 

2 Problem Formulation and Motivations 

Let q be a random vector, bounded in a compact set Q, with a multivariate probability density 
function w(q). Let u(q) be a real scalar measurable function of the random vector q with cumulative 
probability distribution F u {^) := P ro {, {u(q) < 7} for a given 7 € R. Let q 1 , q 2 , ■ ■ ■ , q N be the i.i.d. 
(independent and identically distributed) samples of q generated according to the same probability 
density function w{q) where N is the sample size. Now define random variable Uj, i = 1, 2, ■ ■ ■ , N 
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as the i—th smallest observation of u(q) during N sample experiments. These random variables are 

called order statistics [21 [7] because u\ < U2 < 113 < < ^tv- 

We are interested in computing the following probabilities: 

• Prob {Prob {u(q) > ^n} — e } f° r anv 1 < n < N , and e € (0, 1); 

• Prob {Prob { u (o) < I'm} < e} for any 1 < m < N, and e € (0, 1); 

• Prob {Prob {u m < u(q) < u n } > 1 — e} for any 1 < m < n < N, and e S (0, 1). 

In the subsequent subsections, we shall give some motivations for computing such probabilities. 



2.1 Robust Analysis and Optimal Synthesis 

As noted in [9] and [12j , to tackle robust analysis or optimal synthesis problem, it is essential to deal 
with the following questions: 

• What is maxg «(<;) (or minQu(q))? 

• What is the value of q at which u(q) achieves minQit(g) (or maxg «((/))? 

v 







AI 






y 




u 






■A(q) 







' A(q) 


B{q) ' 


. C(q) 


D{q) 



Figure 1: Uncertain System 

Consider, for example, an uncertain system shown in Figure [TJ Denote the transfer function from 
v to z by T zv and suppose that T zv has the following state space realization T zv 
We can now consider following robustness problems: 

• Robust stability: Let u(q) := maxj Re Xi(A(q)) where \i(A) denotes the i-th eigenvalue of A. 
Then the system is robustly stable if max q£ Qu(q) < 0. 

• Robust performance: Suppose A(q) is stable for all q € Q. Define u(q) := HT^H^. Then the 
robust performance problem is to determine if max gg Q u(q) < 7 is satisfied for some prespecified 
7 > 0. 
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Figure 2: Synthesis Framework 

As another example, consider a dynamical system shown in Figure [2] and suppose q is a vector of 
controller parameters to be designed. Denote the transfer function from d to z by T z d and suppose 



T z d has the following state space realization T z & 
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Let u(q) := ||T Zfl 



and 



Q s = {q G Q : A s (q) is stable}. Then an optimal design problem is to determine a vector of 
parameters q achieving ming 3 u(q). 

In general, exactly evaluating ming u(q) (or maxg u(q)) or determining q achieving it may be 
an NP hard problem and thus is intractable in practice. Henceforth, we adopt the probabilistic 
approach proposed in [9] and [12]. That is, estimating mingu(g) as 



mm m 

ie{l,2,-,JV} 



for sufficiently large N and computing P ro b {Prob {u(q) < u\} < e} for a small e £ (0, 1) to see how 
reliable the estimation is. Similarly, we estimate maxg u(q) as un = max ie{i,2,--- ,N} u i f° r sufficiently 
large N and consider P ro b {P ro b {u(q) > un} < e}- 



2.2 Quantity Range 

In many applications, estimating only the upper bound (or lower bound) for a quantity is not 
sufficient. It is also important to estimate the range of the quantity with a certain accuracy and 
confidence level. For example, in pole placement problem, we need to know the range which the 
poles fall into. Suppose that q is the vector of uncertain parameters or design parameters of a system 
and u{q) is an uncertain quantity, for example, u(q) may be the norm of a closeddoop transfer 
function or the maximum real part of the eigenvalues of the closeddoop system matrix. Intuitively, 
the range of quantity u(q) can be approached by (u\,un] as sample size N goes to infinity. Therefore, 
it is important to know P ro b {P ro b {u\ < u(q) < un} > ^ — 

So far, we have only concerned the lower bound and (or) upper bound of uncertain quantity u(q). 
Actually, it is desirable to know its distribution function F u (.). This is because F u (.) contains all 
the information of the quantity. However, the exact computation of F u (.) is, in general, intractable 
|16| . An alternative is to extract as much as possible the information of the distribution function 
F u (.) from the observations Uj, i = 1, 2, • ■ ■ , N. For this purpose, we are interested in computing 
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the probabilities asked at the beginning of this section. In particular, we will see in section 4 
that, computing P ro b {P ro b {u(q) > u n } < e} is of great importance to make the tradeoff between the 
performance gradation and risk when designing a controller. 



3 Distribution Inequality 

Note that P ro b{u(q) < ui\ = F u (ui), i = 1, 2, • • • , N. To compute the probabilities asked at the 
beginning of section 2, it is important to know the associated distribution of any k random variables 
F u (u h ), F u (u i2 ), ■■■ , F u (u ik ), 1 < i x < i 2 < ■■■ < i k < N, l<k<N, i.e., 

F(ti,t 2 , ■ ■ ■ ,t k ) := ProbiKiuh) <h, F u (u i2 )<t 2 , F u (u ik ) < t k } . 

To that end, we have the following theorem which follows essentially by combining Probability 
Integral Transformation Theorem in [8] and Theorem 2.2.3 in [7]. 



Theorem 1 Let = t < t x < t 2 < • • • < t k < 1. Define 

s=k 



, (x s+1 -x s )^ +1 ^" 1 
(*»+i - is- I)' 



with xq := 0, x k+ \ := I, iq := 0, i k+ \ := N + 1. Suppose the cumulative distribution function 
Fu(l) '■= Prob{u(q) < 7} is continuous. Then 

F(t 1 ,t 2 , ■ ■ ■ ,t k ) = / fh,i 2 ,--,i k {xi,x 2 , - ■ ■ ,x k ) dx 1 dx 2 ■ ■ ■ dx k 

where T>ti,t 2 ,- ,t k '■= {( x l> x 2, •■■ ,%k) ■ < x x < x 2 < ■ ■ ■ < x k , x s < t s , s = 1, 2, • • • , k} . 

Remark 1 Theorem [I] can play an important role in robust control as illustrated in the following 
sections. However, its further application is limited by the continuity assumption. In many robust 
control problems, it is reasonable to assume that u(q) is measurable, while the continuity of F u (j) 
is not necessarily guaranteed. For example, F u {^) is not continuous when uncertain quantity u(q) 
equals to a constant in an open set of Q. We can come up with many uncertain systems with 
which the continuity assumption for the distribution of quantity u(q) is not guaranteed. To tackle 
these problems without continuity assumption by probabilistic approach and investigate the minimum 
computational effort, we shall develop a distribution inequality which accommodates the case when 
the continuity is not guaranteed. 

First, we shall established the following lemma. 

Lemma 1 Let U be a random variable with uniform distribution over [0, 1] and U n , n = 1, 2, • • • ,N 
be the order statistics of U, i.e., U\ < U 2 < ■ • • < Un. Let = to < t\ < t 2 < ■ ■ ■ < t k < 1. 
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Define G 3uh ,.., jk (t 1} t 2 , • • • ,t k ) := (1 - i fc )"-ltii» nj=i (^f 1 " **-i) ifl ^i,**,- : = 
{(ji,j2, • • • ,3k) ■ is <Yfi=xjl < N , s = 1,2,- ■■ ,k} . Then 

ProbyJii <t±,Ui 2 <t2,- ■ ■ ,Ui h <tfcj = ^ Gj 1 j 2) ... j k (ti,t 2 , ■ ■ ■ ,t k ) 

Cjija,— ,ife)eii 1 ,, 2 ,... 

Proof. Let j s be the number of samples of U which fall into (i s — i, t s ], s = 1, 2, 3, • • • , k. Then the 
number of samples of U which fall into [0, t s ] is Y2i=i3l- ^ is easy to see that the event $Ui a < t s | 
is equivalent to event {i s < X^=iJ/ — N}. Furthermore, the event 

{tfh <h,u i2 <t 2 ,--- ,u ik <i fc } 

is equivalent to the event {i s < ^4=1 ji < N, s = 1, 2, ■ ■ ■ , kj . Therefore, 

Prob <\Uii <t\,Ui 2 < *2) ' " ) Ui k < tfc j 



Cjij2)-)i*)eii 1 ,» 2 ,...,i fc s=1 



□ 



Theorem 2 Lei = to < *l < *2 < • • • < ifc < 1. Define 

F(ti,t 2 , ■■■ ,t k ) := P rob {^(njj < ti, F u (u i2 ) <t 2 , ■■■ , F u (u ik ) < t k } 
and t s := supr^, _f u ( x )<j s } F u (x), s = 1, 2, • • • , fc. Suppose u(q) is a measurable function of q. Then 

F(h,t 2 , ■ ■ ■ ,t k ) = / f ili2 i k (xi,x 2 ,--- ,x k ) dx 1 dx 2 ---dx k . 



>T 1 ,T 2 ,'- - ,T k 



Furthermore, F(ti,t 2 ,--- , tfe) < j* Dti ( ... fh,i 2 ,- ,h ( x i> ^2, ■ • • ,^fc) dx 1 dx 2 ---dx k and the equality 
holds if F u {^i) is continuous. 

Proof. Define ao := — oo and a s := sup {x : F u (x) < t s } , aj" := ot s — e, s = 1, 2, ■ ■ ■ , k where 
e > can be arbitrary small. Let (f) s := F u (a~), s = 1,2, ••• , k. We can show that <f>i < (f) s 
if a\ < a s , 1 < I < s < k. In fact , if this is not true, we have <j>i = <j) s . Because e can 
be arbitrary small, we have a~ G (ai, a s ). Notice that ai = min{x : F u (x) > t{\ , we have 
U < (f>s — 4>l- On the other hand, by definition we know that ct7 G {x : F u (x) <t{\ and thus 
4>l = F u (a^) < ti, which is a contradiction. Notice that F u {~f) is nondecreasing and right-continuous, 
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we have ot\ < 02 < • • • < ot k and < 0i < 02 < • • • < <f) k < 1 and that event {F u (ui s ) < t s } is equiv- 
alent to the event {ui s < a s }. Furthermore, event {^(n^) < t±, F u (ui 2 ) < t2, • • • , F u (ui k ) < t k } 
is equivalent to event {u^ < a±, Ui 2 < «2, ■ ■ ■ , Ui k < a k } which is defined by k constraints Ui a < 
a s , s = 1, 2, • • • , k. For every I < k, delete constraint < cti if there exists s > I such that a s = ckj. 
Let the remained constraints be uj < a' s , s = 1, 2, • • • , k' where a x < a 2 < ■ ■ ■ < a' k ,. Since all con- 
straints deleted are actually redundant, it follows that event {u^ < a\, u.- L2 < 0:2, ■ ■ ■ , Ui k < a k } is 

equivalent to event < u ./ < a\ , u ./ < a' 2 , • ■ ■ , u ■' < a , >. Now let j s be the number of observations 
I h 12 V k J 

of u(q) which fall into [a s _i,a s ), s = 1,2, •• • , k . Then the number of observations of u(q) which 
fall into (— 00, a s ) is X^=iiz- ^ i s eas y to see * na * * ne even t j^V < a l| is equivalent to the event 

|« s < Ylt=iji ^ -^j- Furthermore, the event <^uj < a 1 , uj < a 2 , ■•• , uj < a k , j is equivalent to 

event < Yli=i 3i — ^ s = L 2, • • • , /c' j . Therefore 

F(h,t 2 , ■■■ ,t k ) = P rob {F u (u h ) < t\, F u (u i2 ) <t 2 , • ■ ■ , F u (u ik ) < t k } 
= Prob {u-h < a%, u i2 < a 2 , • • • , u ik < a k } = P rob < Uj < a x , Uj < a 2 , ■ ■ ■ , uj < a' k 

L 1 2 k' 

I 

£ fl ( N ~ f ajl ) I^(«r) - Fu(a' s _-)} js [1 - F u (a k D] N -^ lil 

0'1J2,-,V)6I./ ./ ,/ s=l V Js ' 



n,32,~,3 k > I VI: V2, 



Chj'2,- >i fe O e V v 



Now consider event jf)^ < ^1, f/j 2 < (^2, ■ ■ • , < <^fc|- For every / < /c, delete constraint f/j ; < (pi 
if there exists s > I such that 4> s = <p\. Notice that 4> s = F u (aj) and <p\ < 4> s if a\ < a s , 1 < I < s < k, 
the remained constraints must be be < <j) s , s = 1, 2, • • • , A;' where 0' s = F u (a' s ), s = 1, 2, • • • , k' 
and < 02 < • • • < 0^/. Since all constraints deleted are actually redundant, it follows that event 

{f/ii < 01, Ui 2 < V2; • ■ ■ ) ^ife < 0fc} is equivalent to event < 0' x , [K/ < 0' 2 , • • • , < 0' fc , 
By Theorem 2.2.3 in [7] and Lemma Q] 

/ fi u i 2 ,-,ik( x ii x 2, ■ ■ ■ ,x k ) dxidx 2 - ■ ■ dx k 

= Prob {^ii < 01, < 02, ' • • , ^i fe < 0fc} = -Profe | ^ < 01, < 2 , • • • , ^ < 0^, | 

E ^ 

0'i j2,--- ,i,/)6i./ ./ ./ 



J2,--- ^ VI, V2: 



Therefore, F(ti,t 2 , ■■■ ,tk) = M y fhM,~ x 2, x k ) dx±dx 2 ■■■ dx k . By the definitions 

of r s and S , we know that D TljT2i ... jTfe is the closure of D^^,...^, i.e., D nj75) ... )Tfe = D^^^...^ 
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and that their Lebesgue measures are equal. It follows that 



F{h,t 2 , ■ ■ ■ ,t k ) = / f il) i 2t ... jik (x l ,X2,--- ,x k ) dx 1 dx 2 ---dx k . 

Notice that t s <t s , s = 1,2, ■ • • , k, we have D TliT2i ... )Tfe C D tl]t2] ... )tfc and hence 

F(t!,t 2 ,- ■ ■ ,t k ) < / fi 1)i2) ... )ik (xi,X2,--- ,x k ) dxidx 2 ---dx k . 

■/D tl ,t 2 ,...,t ft 

Furthermore, if F u {^j) is continuous, then t s = t s , s = 1, 2, • • • , fc, hence D Tl)T2) ... )T(i 

and the equality holds. □ 

4 Performance and Confidence Tradeoff 

For the synthesis of a controller for an uncertain system, we usually have a conflict between the 
performance level and robustness. The following theorem helps to make the tradeoff. 

Theorem 3 Let 1 < n < N, 1 < m < N and e G (0, 1). Suppose u(q) is measurable. Then 

ATI 

Prob {Prob {<q) >Un}<e}>l- J - xf^dx (1) 

and the equality holds if and only i/sup| x . f u (x)<i-e} Fu(%) = 1 — £/ Moreover, 

Prob {Prob Hq) <u m }<e}>\- -— -x N ~ m (l - x) m ~ l dx (2) 

Jo [tti — 1)'(-/V — my. 

and the equality holds if and only if m.i{ x . f u (x)>e} Pu(x) = £. 

Proof. Apply Theorem [2] to the case of k = 1, i\ = n, we have 

P r ob{Fu{u n ) < 1 - e} 

x n -\l-x) N - n dx< / ^— -x^il-x) N ~ n dx 



lr>r (n-l)\(N-n)l y ' -J (n-l)\(N-n)\ 

where D r = (0,r] with r = supj^.. f u (x)<i-e} F u (x). Therefore, 

Prob {Prob {u{q) > U n } < s} = P ro b {F u (u n ) > 1 - e} 

= 1 - P rob {F u (u n ) < 1 - e} > 1 - / -. — — rrx n ~\l - x) N ~ n dx. 

Jo {n-l)\{N-n)\ 

The equality holds if and only if sup^. f u (x)<i-e} F u {x) = 1 — e because D r = (0, 1 — e] if and only 
if r = sup {x: Fu (x)<i-e} F u(x) = 1 - e. 

Now let v(q) = —u{q). Let the cumulative distribution function of v{q) be F v {.) and define 
order statistics Vi, i = 1, 2 • • • , iV as the i-th smallest observation of v(q) during N i.i.d. sample 



experiments, i.e., v\ < vi < V3 < < vn- Obviously, u m = —VN+i-m for any 1 < m < N. It is 

also clear that F v {— x) = 1 — F u (x~), which leads to the equivalence of sup^. f v (x)<1-e} Pv{x) = 1 — £ 
and infj^. f u (x)>e} F u {x) = e. Therefore, apply ([T]) to the situation of v(q), we have 

Prob {Prob {u(q) < « m } < £} 
= Prob {Prob Mq) > VN+l-m} < e} > 1 - — — -X N ~ m (l - X^dx 

J (m — l)l(Jy — my. 

and the equality holds if and only if inf{ x . f u (x)>e} Pu( x ) = £• Q 

In Figure Owe computed the lower bound for P ro b {Prob {u(q) > u n } < ^} for sample size N = 
8000 with e = 0.0010, e = 0.0012, and e = 0.0015 respectively. 




e=0.0010 

94 I 1 i 1 

7850 7900 7950 8000 

n 



Figure 3: Confidence Level := P ro b {Prob {u(q) > u n } < e}. Sample size N = 8000. Performance 
level increases as n decreases, while confidence level decreases. 

Theorem [3] can be used as a guideline to robust control analysis and synthesis. For example, 
when dealing with robust stability problem, we need to compute the maximum of the real part of 
the closed-loop poles, denoted by u(q), which is a function of uncertain parameters q. When we 
estimate the upper bound of u(q) by sampling, it is possible that most of the samples concentrated 
in an interval and very few fall far beyond that interval. If we take un as the maximum in the design 
of a controller, it may be conservative. However, if we choose n such that u n is much smaller than 
un, while P ro b {P ro b {u(q) > u n } < e} is close to 1, then the controller based on u n may have much 
better performance but with only a little bit more increase of risk. For example, let's say, sample size 
N = 8000 and e = 0.0010, the distribution of sample is like this, u\, U2, • ■ ■ , W7900 concentrated in an 
interval, and U7900 is much smaller than U7901, ^7902 > • • • , ^sooo- It is sure that the controller designed 
by taking A7900 as the upper bound will have much higher performance level than the controller 
designed by taking iisooo as the upper bound. To compare the risks for these two cases, we have 
Prob {Prob Mq) > n 8 ooo} < 0.0010} > 0.99966 and P rob {P rob {u(q) > u 7900 } < 0.0010} > 0.99951. 
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These data indicate that there is only a little bit more increase of risk by taking M7900 instead of 
nsooo as the upper bound in designing a controller. 

5 Minimum Sample Size 

In addition to the situation of making the tradeoff between performance degradation and risk, The- 
orem [3] can also play an important role in the issue of computational effort required to come up 
with an estimate of the upper bound (or lower bound) of a quantity with a certain accuracy and 
confidence. This issue was first addressed independently by Tempo, Bai and Dabbene in [12] and 
Khargonekar and Tikku in [5] and their results are summarized in the following theorem. 

In i 

Theorem 4 For any e,5 G (0, 1), P rob {P rob {u(q) > u N } <e}>l-SifN> - — f-. 

ln 1-6 

Remark 2 This theorem only answers the question that how much computational effort is sufficient. 
We shall also concern about what is the minimum computational effort. By applying Theorem [3] to 
the case of n = N , we can also obtain Theorem 0. Moreover, we can see that, for a certain accuracy 
(i.e., a fixed value of e), the bound becomes minimum if and only if 

sup F u {x) = l-e. (3) 

{x: F u (x)<l~e} 

If F(u) is continuous (i.e., (Ep is guaranteed for any e € (0, 1) ), the bound is of course tight. 
Similarly, by Theorem [5] to the case of m = 1 we have that for e,5 6 (0, 1), 

Prob {Prob Mq) > Ul} > 1 - e} > 1 - 5 

In - 

if N > — — f — . For a fixed e € (0, 1), this bound is tight if and only if inf{ x . f u (x)>e} Pu{x) = e. 

1 — £ 

6 Quantity Range and Distribution-Free Tolerance Intervals 

To estimate the range of an uncertain quantity with a certain accuracy and confidence level apriori 
specified, we have the following corollary. 

Corollary 1 Suppose F u (^f) is continuous. For any e, 5 6 (0,1), 

Prob {Prob {ui < u(q) < u N } >l-e}>l — 5 

if and only if fJ,(N) < 5 where fJ>(N) := (1 — e)^" 1 [1 + (N — l)e] is a monotonically decreasing 
function of N . 
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Remark 3 The minimum N guaranteeing this condition can be found by a simple bisection search. 
This bound of sample size is minimum because our computation of probability is exact. This bound 
is also practically small, for example, N > 1,483 if e = 5 = 0.005, and N > 9,230 if e = 5 = 
0.001. Therefore, to obtain a reliable estimate of the range of an uncertain quantity, computational 
complexity is not an issue. 

In general, it is important to know the probability of a quantity falling between two arbitrary 
samples. To that end, we have 

Corollary 2 Suppose F u (^y) is continuous. Then for e € (0, 1) and 1 < m < n < N , 

Prob{Prob{u m <u(q)<u n }>l-e}= f n( N ~ l \x n ~ m "\l-x) N ~ n+m dx. 

Jl-e \n-m-lj 

Here (u m , u n ] is referred as distribution-free tolerance interval in order statistics theory (see [7]). 
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